Technical Note—On the Stochastic Ordering of Markov Chains
نویسندگان
چکیده
منابع مشابه
Ordering Monte Carlo Markov Chains
Markov chains having the same stationary distribution can be partially ordered by performance in the central limit theorem. We say that one chain is at least as good as another in the e ciency partial ordering if the variance in the central limit theorem is at least as small for every L( ) functional of the chain. Peskun partial ordering implies e ciency partial ordering [25, 30]. Here we show ...
متن کاملLevel-crossing Ordering of Semi-markov Processes and Markov Chains
We extend the definition of level-crossing ordering of stochastic processes, proposed by Irle andGani (2001), to the case in which the times to exceed levels are compared using an arbitrary stochastic order, and work, in particular, with integral stochastic orders closed for convolution. Using a sample-path approach, we establish level-crossing ordering results for the case in which the slower ...
متن کاملOrdering and Improving the Performance of Monte Carlo Markov Chains
An overview of orderings defined on the space of Markov chains having a prespecified unique stationary distribution is given. The intuition gained by studying these orderings is used to improve existing Markov chain Monte Carlo algorithms.
متن کاملTaylor Expansion for the Entropy Rate of Hidden Markov Chains
We study the entropy rate of a hidden Markov process, defined by observing the output of a symmetric channel whose input is a first order Markov process. Although this definition is very simple, obtaining the exact amount of entropy rate in calculation is an open problem. We introduce some probability matrices based on Markov chain's and channel's parameters. Then, we try to obtain an estimate ...
متن کاملStochastic Dynamic Programming with Markov Chains for Optimal Sustainable Control of the Forest Sector with Continuous Cover Forestry
We present a stochastic dynamic programming approach with Markov chains for optimal control of the forest sector. The forest is managed via continuous cover forestry and the complete system is sustainable. Forest industry production, logistic solutions and harvest levels are optimized based on the sequentially revealed states of the markets. Adaptive full system optimization is necessary for co...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Operations Research
سال: 1975
ISSN: 0030-364X,1526-5463
DOI: 10.1287/opre.23.3.574